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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1 .1 7(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .1 7(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on May 20, 
2005 has been entered. 

Response to Amendment 

2. In response to the Office Action mailed May 1 1 , 2005, applicant submitted an 
amendment filed on May 20, 2005, in which the amended and requested 
reconsideration with respect to independent claims 1 and 14 and newly added claims 
15-17. 

Response to Arguments 

3. Applicant argues that Jiang does not teach or suggest inserting additional, paired 
and/or higher order information, including semantic and/or pragmatic information, 
between the sub-phrases, thereby decreasing the burden of searching, wherein the 
semantic information includes description of the sub-phrases and the pragmatic 
information includes connecting information connecting sub-phrases to actual situation, 
application and/or action. 
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Applicant's arguments, see remarks, filed May 20, 2005, with respect to the 
rejection(s)of claim(s) 1 and 14 under U.S.C. 103 have been fully considered and are 
persuasive. Therefore, the rejection has been withdrawn. However, upon further 
consideration, a new ground(s) of rejection is made in view of Kimura et al. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 1-2, 4-5, 9 and 14 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Jiang et al. (U.S. Patent No. 6,539,353), hereinafter referenced as 
Jiang in view of Ehsani et al. (U.S. Publication No. 2002/0128821), hereinafter 
referenced as Ehsani and in further view of Kimura et al. (USPN 6,067,510), hereinafter 
referenced as Kimura. 

As per claims 1 and 14, Jiang discloses a method and apparatus for recognizing 
speech, comprising: 

(a) the steps of receiving a speech phrase (100, FIG. 2); 

(b) generating a signal being representative to said speech phrase using A/Q 
converter (102, FIG.2); 
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(c) using feature extractor for pre-processing and storing said signal (104, FIG. 

2); 

(d) generating from said pre-processed signal at least one series of hypothesis 
speech elements (Col. 1, line 51-53); 

(e) determining at least one series of words being most probable to correspond 
to said speech phrase by applying a predefined language model to at least said series 
of hypothesis speech elements (Col. 4, lines 13-16), 

wherein the step of determining said series of words further comprises the steps 

of: 

(1) identifying a hypothesis string consisting of sub-word units (Col. 1, lines 52- 
55) then continuing determining words or combinations of words and which are 
consistent with said seed sub-phrase as at least a first successive sub-phrase which is 
contained in said received speech phrase (Col. 6, lines 38-46 with Col. 5, lines 28-51 
and Col. 4, lines 33-44), but lacks identifying and extracting word classes of high- 
perplexity, applying a compiler, merging the sub-word-unit grammars with the remaining 
low-perplexity part and inserting additional information. 

Ehsani discloses phrase-based dialogue modeling method for producing a low- 
perplexity recognition grammar from a conventional grammar having semantic 
information including a description between sub-phrases (column 3, paragraphs 0034- 
0043) comprising: 
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(a) identifying and extracting word classes (trigram subsumed under the fixed 
collocation) of high-perplexity (very high perplexity) from the conventional grammar 
(column 5, paragraphs 0100-0102); 

(b) generating a phonetic, phonemic and/or syllabic description (phone models 
and phonetic dictionary; column 11, paragraph 0217) of high-perplexity word classes 
(very high perplexity), in particular by applying a sub-word-unit grammar compiler to 
them (column 11, paragraphs 0211-0214 with column 10, paragraphs 0199-0200), to 
produce a sub-word-unit grammar for each high-perplexity word class (columns, 
paragraphs 0100-0102); and 

(c) merging sub-word-unit grammars (combining) with remaining low-perplexity 
part of the conventional grammar to yield said low-perplexity recognition grammar 
(column 4, paragraphs 0064 with column 6, paragraph 0107), to measure the strength 
of certain collocations. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Jiang's method wherein it identifies and extracts 
word classes of high-perplexity, applies a compiler and merges the sub-word-unit 
grammars with the remaining low-perplexity part, to measure for determining the 
average branching factor of a recognition network, for evaluating language models 
(column 5, paragraph 0100). 

Jiang in view of Ehsani discloses a method and apparatus for recognizing 
speech, but does not specifically teach inserting additional information. 
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Kimura teaches inserting additional, higher order information (hierarchy), 
including semantic (semantic features), between the sub-phrases, thereby decreasing 
the burden of searching (greatly reduce labor and time to search; column 3, lines 43- 
51), wherein the semantic information includes description of the sub-phrases (column 
5, lines 38-56 with column 12, lines 22-26 and column 15, line 36-43). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Jiang in combination with Ehsani's method and 
apparatus such that it discloses inserting additional information, to sort and display 
words hierarchically in a particular order when displaying the words as candidates for 
substitution so that a time for retrieving the words can be reduced, as taught by Kimura 
(column 2, lines 1-6). 

As per claim 2, Jiang et al. disclose the use of a language model (110, FIG. 2) to 
provide additional information about the set of probabilities that a particular sequence of 
words will appear in the language of interest (Col. 4, lines 33-44) 

As per claims 4 and 5, Jiang et al. discloses that language model (110, FIG- 2) 
is a compact trigram model that determines the probability of sequence of words based 
on the combined probabilities of three-word segment of the sequence. (Col.4, lines 41- 
44). Inherently, trigram language models take prepositional relationships of sub- 
phrases into account when calculating probabilities. 

As per claim 9, Jiang et al. discloses the use of Hidden Markov Models for 
estimating probabilities for any sequence of sub-words generated by lexicon (Col. 4, 
lines 23-30). 
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As per claim 15, Jiang discloses and method and apparatus for recognizing 
speech, but does not specifically include information relating to grammatical constraints 
among said sub-seed. 

Ehsani discloses a speech recognition method and apparatus including 
information relating to grammatical constraints among said sub-seed (column 11, 
paragraph 0221), to narrow down the hypotheses generated by the acoustic signal. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Jiang's method and apparatus wherein it 
includes information relating to grammatical constraints among said sub-seed, to narrow 
down the hypotheses generated by the acoustic signal, to come up with a number of 
possible commands that are processed by the system (column 1 1 , paragraph 0221). 

As per claim 16, Jiang discloses and method and apparatus for recognizing 
speech, but does not specifically include grammatical constraints for a name of a city. 

Ehsani discloses a speech recognition method and apparatus including 
grammatical constraints for a name of a city (column 10, paragraph 0196), to enable the 
phrase thesaurus to be represented more compactly. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Jiang's method and apparatus wherein it 
includes grammatical constraints for a name of a city, to enable the phrase thesaurus to 
be represented more compactly thus decreasing the data storage capacity required to 
store the data representing the phrase thesaurus (column 10, paragraph 0197). 
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As per claim 17, Jiang in view of Ehsani disclose and method and apparatus for 
recognizing speech, but does not specifically discloses pragmatic information including 
digital postal code for the city. 

Ehsani teaches that the descriptors include businesses, restaurants, cities, etc. 
(column 10, paragraph 0196). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Jiang's method and apparatus such that it 
includes a 5-digit postal code for the city, to allow the information to be received 
hierarchically with a large variety of different domains (column 2, paragraph 0022). 

6. Claims 6-7 and 10-12 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Jiang in view of Ehsani and Kimura, as applied to claims 1 and 14 
above, and in further view of Chou et al. (U.S. Patent No. 5,797,123), hereinafter 
referenced as Chou. 

As per claim 6 and 7, Jiang in view of Ehsani and Kimura does not disclose the 
use of low-perplexity and high-perplexity pads in the system. 

Chou teaches limited vocabulary word spotting (low perplexity) with a parallel 
network of subword models used to model the non-keyword portions of the input 
utterance (high-perplexity) (Col. 2, lines 61-65). Inherently, sub-word models contain 
word fragments. 
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Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Jiang in combination with Ehsani and Kimura's 
method and apparatus, as taught in Chou, in order to improve the speed of recognition 
by quickly identifying commonly-used words using low-perplexity vocabulary and then 
proceeding to identify the less-common words by resorting to more expansive 
computations. 

As per claim 10, Jiang in view of Ehsani and Kimura does not disclose the 
insertion of high-perplexity word classes into hypothetic graph. 

Chou teaches the insertion of functional words and filler phrases into the 
detection network to improve recognition of key-phrases (Col. 6, lines 47-56). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Jiang in view of Ehsani and Kimura's method 
and apparatus, as taught in Chou, in order to handle repeating speech patterns and 
thus speed up the search and improve recognition. 

As per claim 11, Jiang in view of Ehsani and Kimura do not disclose the removal 
of candidates from the hypothetical graph. 

Chou teaches the merging of the states of the key-phrase network, thus reducing 
its size (Col. 7, lines 40-46). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Jiang combination with Ehsani and Kimura 
method and apparatus, as taught in Chou, in order to prune the passed nodes while 
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doing the search through the hypothetical network and thus limit the possibility to 
accidentally encroach upon the beginning of another phrase. 

As per claim 12, Jiang in view of Ehsani and Kimura do not disclose restricting 
the remaining part of the key-phrase. 

Chou teaches placing additional constraints on the search that inhibit impossible 
connections of key-phrases (Col. 6, lines 64-65). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Jiang in combination with Ehsani and Kimura 
method and apparatus, as taught in Chou, in order to improve the speed of recognition 
by quickly removing impossible combinations from the search graph and thus limiting 
the search space. 

Conclusion 

7. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

• Nevin, III (USPN 6,714,936) discloses a method and apparatus for displaying 
data stored in linked nodes 

• Hurley et al. (USPN 6,678,882) disclose collaborative model software systems 
with synchronization submodel with merge feature, automatic conflict resolution 
and isolation of potential changes for reuse. 

• Onishi et al. (USPN 6,154,720) disclose a conversational sentence translation 
apparatus allowing the user to freely input a sentence to be translated. 
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• Saraki (USPN 5,903,858) discloses a translation machine for editing a original 
text by rewriting the same and translating the rewrote one. 

• Nakatsuyama et al. (USPN 5,752,021) disclose a document database 
management apparatus capable of conversion between retrieval formulae for 
different schemata. 

8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Jakieda R Jackson whose telephone number is 
571 .272.7619. The examiner can normally be reached on Monday through Friday from 
7:30 a.m. to 5:00p.m. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Wayne Young can be reached on 571 .272.7582. The fax phone number for 
the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). V . N , 




JRJ 

July 21, 2005 



